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Implicit  systems  of  differential  equations  of  the  form  F(t,y,y‘ )  =  0  naturally 
arise  in  many  circuit  and  control  problems ,  economic  models,  and  the  solution  of 
partial  differential  equations  by  the  method  of  lines.  Implicit  systems  are  also 
called  singular,  differential -algebraic,  semi-state,  constrained,  and  descriptor. 
The  theory  is  well  understood,  and  numerical  codes  exist,  for  index  zero,  index 
one,  and  linear  constant  coefficient  problems.  Higher  index  systems  occur  in 
circuit  and  control  problems.  The  numerical  and  analytic  behavior  of  such  higher 
index  systems  is  not  well  understood  and  is  incomplete.  It  has  recently  been 
shown  that  traditional  methods,  such  as  backward  differences,  need  not  work  on 
higher  index  systems.  Good  characterizations  of  the  solution  manifold  cure  often 
difficult  to  obtain.  This  research  project  is  to  study  the  numerical  and 
analytic  solution  of  higher  index  implicit  differential  equations.  Applications 
will  be  made  to  circuit  theory,  control  theory,  and  the  analysis  of  numerically 
ill-conditioned  index  one  systems. 
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Additional  references  of  the  principal  investigator  [Ci]  and  others  [Ri]  appear 
at  the  end  of  this  report. 
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If  a  system  of  differential  equations  is  written  as 


u'  =  f(u,v,t) 
0  =  g(u,v,t) 


then  the  system  (1)  is  called  index  one  if  ^  is  nonsingular.  In  this  case  the 
algebraic  constraint  (lb)  may  be  solved  for  v,  to  give  v  =  * (u, t)  and  (la) 
becomes  an  explicit  equation  u'  =  f(u,  *(u,t),  t) .  However,  in  some  control 
applications  [Cl],  [C7],  [Rl],  [R5]  the  matrix  is  always  singular.  These 


problems  are  called  higher 
general  system 


> .  Definitions  of  index  for  the  more 


F(x,x'  ,t)  *=  0 


appear  in  [C5] .  Traditionally  (1)  has  been  numerically  solved  using  backward 
difference  formulas  (BDF)  [R2],  [R3].  Recently,  it  has  been  shown  that  BDF's 
need  not  converge  both  for  nonlinear  [C5]  and  linear  time  varying  [R3] 


A(t)x* (t)  +  B(t)x(t)  =  f(t) 


higher  index  systems.  Prior  to  the  work  of  the  principal  investigator,  no 
general  method  for  the  numerical  solution  of  (3)  existed. 
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An  approach  to  numerically  solve  (3)  was  proposed  in  [C4] .  However, 
numerous  questions  on  the  practical  implementation  and  theoretical  implications 
of  this  method  remained  unresolved.  Some  of  these  problems  have  now  been 
resolved. 

The  key  idea  in  [C4]  was  as  follows.  Suppose  that  (3)  is  solvable  on  an 
interval  7.  That  is,  for  every  stiff iciently  smooth  input  f  there  is  at  least  one 
solution  x  and  the  solutions  for  a  given  f ,  are  uniquely  determined  by  their 
value  at  any  time  t  e  7.  From  [C2]  it  is  known  that  the  solution  can  depend  not 
only  on  A,  B,  f  but  also  their  derivatives.  Assume  that  A,B,f  are  sufficiently 
smooth  on  7  and  at  time  t  €  7,  let  {A^},  {B^ > ,  {x^},  { f ^ }  be  the  Taylor 
coefficients  of  A,  B,  x,  and  f  respectively.  These  functions  do  not  have  to  be 
infinitely  differentiable,  just  sufficiently  differentiable.  Then  for  any  j  >  0, 
any  t  e  7,  equation  (3)  implies  that  the  coefficients  satisfy 


or  more  compactly 

Vj  *  fr  151 

In  [C4]  it  is  shown  that  for  all  known  classes  of  solvable  systems  that  if  j  is 
appropriately  chosen,  then  (5)  uniquely  determines  x  even  though  x.  is  not 

•  J 

unique.  Since  x^^  =  x‘(t)  it  is  now  possible  to  define  a  method  to  integrate  (3). 


This  general  approach  was  refined  and  improved  by  the  principal  investigator 
in  [Pi].  This  paper  made  several  contributions.  First,  it  examined  the 
numerical  considerations  in  solving  (5)  and  showed  how  to  do  so  in  a  numerically 
reliable  manner.  Secondly  it  greatly  reduced  the  computational  effort  of  the 
method  proposed  in  [C4]  by  showing  how  (5)  could  be  used  to  define  an  explicit 
differential  equation  x*  =  R{t)x  +  r(t)  at  each  time  step.  This  made  possible 
the  definition  of  both  Adams  and  Runge-Kutta  methods.  Due  to  the  smaller  sized 
coefficient  matrices  involved,  these  methods  were  more  efficient  than  the  higher 
order  Taylor  methods  of  [C4], 

One  previous  difficulty  with  many  of  the  approaches  for  solving  (3), 
including  the  BDF,  has  been  the  lack  of  general  methods  for  finding  the  manifold 
of  consistent  initial  conditions.  In  [P4]  the  principal  investigator  showed  that 
for  many  classes  of  solvable  systems,  that  the  equations  (5)  could  be  used  to 
develop  an  algorithm  for  calculating  the  consistent  initial  conditions.  This  is 
the  first  general  method  for  doing  so  based  strictly  on  the  coefficients  of  A,  B, 
f  and  not  requiring  a  series  of  time-varying  coordinate  changes.  While  the 
results  reported  so  far  made  substantial  progress  on  the  analysis  of  the  linear 
time  varying  system  (3),  several  major  difficulties  remained.  Among  these  were 
the  lack  of  either  any  explicit  criteria  for  solvability  or  good  descriptions  of 
how  to  approximate  one  linear  system  by  another.  Substantial  progress  has  been 
made  in  this  direction  within  the  last  few  months  in  [P6] . 

Prior  characterizations  of  solvability,  often  amounted  to  being  able  to 
solve  the  problem.  In  [P6],  the  principal  investigator  gave  the  first  explicit, 
verifiable,  characterization  of  solvability  in  the  cases  when  A,B,f  are  either 
real  analytic  or  infinitely  differentiable.  Necessary  conditions  are  given  if 


A,B, f  are  2n- times  differentiable.  These  characterizations  are  stated  directly 
in  terms  of  pointwise  rank  conditions  involving  the  arrays  in  (4) .  Thus  they  may 
be  verified  without  performing  any  coordinate  changes. 


One  consequence  of  [P6]  is  a  proof  that  the  numerical  method  of  [PI]  works 
for  all  smooth  linear  time  varying  implicit  solvable  systems  (3). 

Another  consequence  of  [P6J  is  a  characterization  of  when  the  solution 
manifolds  of  two  linear  time  varying  singular  systems  are  close.  This  is  the 
first  general  approximation  result  to  appear  in  the  linear  time  varying  case. 

The  results  to  date,  especially  [PI],  [P3],  [P6]  have  finally  put  the 
numerical  and  analytic  solution  of  (3)  on  a  firm  footing.  Techniques,  for  the 
first  time,  are  now  available  to  study  the  approximation  and  simplification  of 
general  linear  time  varying  implicit  systems. 

Petzold  and  Gear  [R3] ,  [R4]  have  shown  that  most  higher  index  systems  (3) 
can  be  changed,  at  least  locally,  to  an  index  two  system  by  the  use  of  linear 
time  varying  coordinate  changes.  Thus  the  index  two  case  is  of  considerable 
interest.  In  [C2]  the  principal  investigator  had  given  both  sufficient 
conditions  under  which  a  linear  time  varying  singular  system  was  solvable  and  a 
characterization  of  the  solutions.  In  [P2]  the  principal  investigator  weakened 
the  assumptions  of  [C2]  and  obtained  a  similar  result.  A  series  of  examples  in 
[P2]  showed  that  additional  weakening  is  probably  not  possible.  These  examples 
also  shed  light  on  the  behavior  of  systems  which  are  index  two  but  have  higher 
index  In  a  different  coordinate  system.  These  examples  will  prove  useful  in 
testing  numerical  algorithms. 

There  are  two  natr-al  types  of  coordinate  changes  to  make  when  studying  (3); 
letting  x  =  Q(t)y  and  multiplication  of  (3)  on  the  left  by  P(t).  That  neither  of 
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these  effect  the  analysis  of  [PI],  [P4],  [P6] ,  [C4]  is  one  reason  that  approach 
is  so  useful. 


It  is  known  that  the  question  of  whether  BDF's  converge  is  unaltered  by  time 
varying  P  and  constant  Q  but  can  be  altered  by  time  varying  Q.  Clark  has  defined 
a  modified  backwards  difference  formula  (MBDF)  in  [P5] .  This  method  has  several 
interesting  properties.  For  linear  time  invariant  systems  and  those  in  the 
standard  canonical  form  [C6]  it  is  the  same  as  the  BDF.  However,  the  convergence 
properties  of  the  MBDF  are  unchanged  by  constant  P  and  time  varying  Q,  but  can 
be  altered  by  time  varying  P.  Thus  the  MBDF  methods  provide  a  nice  symmetry  to 
the  theory.  The  methods  of  [PI],  [P4] ,  [C4]  are  unaffected  by  time  varying  P  and 
Q.  Additional  results  on  when  the  BDF  and  MBDF  methods  work  is  given  in  [P7] . 
This  unifies  and  extends  some  of  the  work  of  [Rl] . 

The  current  interest  in  implicit  systems  within  the  mathematical  and 
engineering  communities  is  illustrated  by  the  recent  special  sessions  held  on 
this  topic.  Several  of  these  are  described  in  the  travel  section.  In  addition, 
the  paper  [P2]  will  appear  in  a  special  issue  of  Circuits  Systems  &  Signal 
Processing  on  semistate  equations. 

CURRENT  RESEARCH 

The  application  of  the  reported  research  to  linear  time  varying  control  and 
circuit  problems  is  under  investigation.  Preliminary  results  indicate  that  the 
special  structure  of  many  control  problems  can  be  exploited  to  qreatly  speed  up 
the  numerical  methods  of  [PI].  The  use  of  the  approximation  results  from  [P6]  to 
simplify  specific  implicit  control  problems  is  also  under  investigation.  The 
extension  of  these  results  to  nonlinear  problems  is  being  examined. 


TRAVEL 


Travel  funds  from  this  grant  were  used  to  enable  the  principal  Investigator 
to  attend  the  Society  for  Industrial  and  Applied  Mathematics  (SIAM)  1984  National 
Summer  Meeting  in  Seattle,  Washington,  July  16-20.  A  paper  concerning  this 
research  was  presented.  The  meeting  provided  an  opportunity  to  discuss  the 
proposed  research  with  experts  from  numerical  analysis,  control  theory,  and 
differential  equations. 

July  30  -  August  3,  1984;  the  principal  investigator  attended  and  gave  an 
invited  paper  [PI]  at  the  American  Mathematical  Society  (AMS)  -  SIAM  Research 
Conference  on  "Linear  Algebra  and  Its  Role  in  Systems  Theory" .  Researchers  from 
Engineering  and  Mathematics  with  an  interest  in  control  theory,  systems  theory, 
linear  algebra,  and  numerical  linear  algebra  were  present.  Recent  results  by  the 
principal  investigator  on  the  linear  algebra  problems  that  arise  in  the  numerical 
solution  of  the  implicit  systems  (3)  were  presented. 

December  12-14,  1984;  the  principal  investigator  attended  and  gave  an 
invited  paper  [P3]  at  the  23  IEEE  Conference  on  Decision  and  Control  as  part  of 
a  special  session  on  generalized  state  space  systems. 

June  9-15;  the  principal  investigator  attended  and  gave  an  invited  talk  [P4] 
at  the  1985  Mathematical  Theory  of  Networks  and  Systems  Conference  in  Stockholdm, 
Sweden. 

June  18-23,  1985;  the  principal  investigator  visited  the  University  of 
Bologna,  Italy.  He  gave  a  seminar  on  recent  results  on  singular  systems  and  had 
mathematical  discussions  with  Professor  Angelo  Favini  about  operator  theoretic 
guestions  involving  implicit  systems  of  differential  equations.  While 
considering  these  questions,  the  principal  investigator  was  able  to  prove,  by 
operator  theoretic  means,  one  of  the  key  lemmas  in  [P6]. 


.  June  24  -  26;  the  principal  investigator  attended  the  1985  SIAM  National 
meeting  in  Pittsburgh,  PA.  He  gave  an  invited  talk  in  the  special  session  on 


\ 
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differential-algebraic  equations. 

OTHER  PROJECT  PERSONNEL 
Research  Assistant: 

The  Research  Assistant;  Mr.  Kenneth  Clark,  is  working  on  a  Ph.D.  in  Applied 
mathematics  under  the  direction  of  the  principal  investigator.  Mr.  Clark  has 
recently  developed  some  nice  results  on  the  relationship  between  the  convergence 
of  backward  difference  formulas  and  the  types  of  transformations  needed  to  put  an 
implicit  system  into  a  canonical  form.  These  results  are  reported  in  [P5],  [P7]. 
He  is  expected  to  graduate  in  June,  1986.  An  abstract  of  his  thesis  follows. 

Abstract  of  Research  Assistant  Ph.D.  Thesis 

TITLE:  Difference  Methods  for  the  Numerical  Solution  of  Nonautonamous  Singular 
Linear  Systems. 

ABSTRACT.  Several  aspects  of  the  numerical  and  analytical  treatment  of  singular 
linear  systems 

A(t}x‘  +  B(t)x  =  f(t) 

are  considered.  Here  A(t)  is  assumed  to  be  identically  singular,  and  the 
differential  equation  is  considered  on  the  closed  interval  [0,T].  First,  a  class 
of  modified  difference  schemes  is  derived  for  the  numerical  solution  of  the 
system.  These  methods  are  analyzed  on  several  classes  of  problems  which 
frequently  arise,  and  in  particular  their  convergence  and  stability  is  proved  for 


the  classes  considered.  The  classes  we  examine  include  those  transformable  to 


constant  coefficients,  implicitly  defined  index  one  systems,  and  index  two 
systems  in  semi-explicit  form.  We  show  that  all  of  the  classes  investigated  in 
this  paper  can  be  treated  in  a  more  general  framework  involving  a  special  case  of 
the  standard  canonical  form  for  time  varying  singular  linear  systems,  and  that 
the  structure  of  the  form  is  the  key  element  in  the  analysis. 
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